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We show that topological states are often developed in two dimensional semimetals with quadratic 
band crossing points (BCPs) by electron-electron interactions. To illustrate this, we construct a con- 
crete model with the BCP on an extended Lieb lattice and investigate the interaction-driven topo- 
logical instabilities. We find that the BCP is marginally unstable against infinitesimal repulsions. 
Depending on the interaction strengths, topological quantum anomalous/spin Hall, charge nematic, 
and nematic-spin-nematic phases, develop separately. Possible physical realizations of quadratic 
BCPs are provided. 



I. INTRODUCTION 

The search of new topological states of matter has 
never been stopped since the discovery of the quantum 
Hall state in 1980'sji In particular, in recent years the 
study of "topological insulators" (TI) becomes one of the 
most active fields in condensed-matter physics, not only 
for its importance to fundamental physics but also for its 
potential application in spintronics or thermoelectricsi^ 
This new insulating phase is distinguished from the 
conventional one by a non-trivial Z 2 topological invari- 
ant and robust gapless edge states in two dimensions 
(2D)^~— or surface states in three dimensions (3D)&£, 
against moderate perturbations which preserve time re- 
versal symmetry (TRS). 

Generally such topological insulating state can occur 
in a system with strong spin-orbit coupling that explicitly 
breaks spin rotational symmetry (SRS), resulting in the 
band inversion phenomenon. Typical materials which ex- 
hibit TI phase are found in, for instance, the HgTc/CdTc 
quantum wells (2D), Bi^Sbi-^, Bi 2 Se3, Bi 2 Te3 (3D), and 
so on*£~— However, an alternative route to TI is possi- 
ble and it is associated with the co ncep t of topological 
Mott insulator, first studied in Ref. [ll| in strongly cor- 
related systems. There are two key and generic ingre- 
dients in this approach. First, the Fermi surface of the 
non-interacting system should shrink to discrete points 
(2D) or lines (3D), and hence it is semi- metallic; second, 
there exists a suitable repulsive interaction, which can 
dynamically generate spin-orbit coupling through spon- 
taneously broken SRS, as first discovered by Wu and 
Zhang.— A few pioneering examples along this line of 
thought have been discussed in various lattice geome- 



tries, e.g., honeycomb ) 11 ' 17 ' 18 checkerboard^ kagome^ 
and diamond lattices^ 
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FIG. 1: (Color online) Schematic plot of the 2D (extended) 
Lieb lattice. The dotted curve indicates the unit cell, which 
contains three sublattice sites (A, B, C). 



Here we show that topological states can be gener- 
ally realized in a system with quadratic band crossing 
points (BCPs), which are symmetry protected at non- 
interacting level. Near such kind of BCP, instability to- 
wards phases with broken symmetry symmetries is in- 
evitable even if there is only weak interaction between 
electrons. To demonstrate this, we construct a concrete 
model with such a BCP on an extended 2D Lieb lat- 
tice. There are several reasons for us to choose the Lieb 
lattice. First, the Lieb lattice has three sites per unit 
cell, as shown in Fig. [TJ With only nearest-neighbor 
(NN) hoppings, there is a dispersionless (flat) band in 
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the middle of the band structure. There are three sce- 
narios to alter this non-generic crossing between this flat 
band and the two other bands, depending on the values 
of the onsite potentials or the presence of further range 
hoppings: (i) The flat band touches upper and lower lin- 
early dispersing bands at one point when all lattice sites 
have equal onsite potentials, (ii) The flat band can be 
isolated. For instance, one can add intrinsic spin-orbit 
couplings as discussed by Weeks and Franz ^ (iii) When 
the onsite potential on A sublattice is not equal to that 
of B/C sublattices, the flat band only touches one of the 
other two bands, which becomes quadratically dispers- 
ing, instead of linearly dispersing^ Thus, these choices 
could variegate our results. Second, a nearly flat band 
can have non-zero Chern number (see Sec. IV). Finally, 
the 2D Lieb lattice has been the most important build- 
ing block in many 3D perovskite materials featured with 
complex phase diagram and strongly electron-electron 
correlations. Thus study of the model can be viewed 
as a preliminary investigation of the TI phase especially 
in layered perovskites composed of weakly coupled 2D 
planes with Lieb lattice structure (e.g., the well-known 
high-T c cuprates). 

In this paper, we start with the construction of the 
explicit model and reveal the topological nature of the 
BCP at non-interacting level. We then examine the con- 
sequence of such topological BCP, i.e., with a symme- 
try protected Berry flux 27r, under the presence of short- 
range repulsive interactions. We investigate various sym- 
metry breaking instabilities at BCP within self-consistent 
mean-field approximation. Note that we mainly focus on 
type (iii) band structure, namely, only two bands touch 
together, and compare it with the case of type (i) when 
necessary. In principle, for the BCP there are two ways 
to gain energy: One is to open a gap at BCP, and the 
other one is to split into two Dirac points (each with 
Berry flux 7r), but with the price of broken C4 symmetry. 
To justify this speculation, we show phase diagrams for 
spinless/spinful fermions at 1/3 or 2/3 filling, according 
to the position of the BCP in the band structure. In fact, 
at both fillings the phase diagrams are qualitatively sim- 
ilar with subtle differences due to particle-hole asymme- 
try introduced by the interactions. In the spinless case, 
the leading order under "weak" next nearest-neighbor 
(NNN) repulsion is the quantum anomalous Hall (QAH) 
insulating state (TRS broken). For "strong" NNN re- 
pulsion, the ground state evolves into insulating nematic 
state (C4 symmetry broken down to C2). In addition, 
for intermediate strength, there exists a narrow coexis- 
tence region between these two orders. In the spinful 
case, the phase diagrams are more complicated. Besides 
the phases we find in the spinless case, there are also a 
quantum spin Hall (QSH) insulating state and a nematic- 
spin-nematic semi-metallic phase with Dirac nodesi^r— 
Thus, we clearly demonstrate that, in principle, corre- 
lated systems with Lieb lattice structure can be a poten- 
tial host to TIs. 

This paper is organized as follows. In Section II, we 
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FIG. 2: (Color online) Band structure of the model along 
the high-symmetry lines in the FBZ for (a) ea = and for 
(b) ea — —At. In case (b), when t" = O.lt (with the con- 
straint mentioned in the text) is present, the BCP at M be- 
comes standard QBCP and the spectrum is changed slightly 
as shown by dashed lines. Inset of (a): FBZ of the Lieb lattice. 
There are four time reversal invariant momenta: T, X, M, and 
Y. 

define the model and demonstrate the topological nature 
of its BCP from both momentum and real-space point 
of view. Next, the consequences of introducing short- 
range repulsions are discussed for spinless fermions in 
Section III A and for spinful fermions in Section III B, 
respectively. Finally, we discuss some issues and make 
conclusions in Sec IV. 



II. THE LATTICE MODEL 

We begin with the tight-binding model for non- 
interacting fermions, 

Ho = - tijcjcj + Y Ci» C 1 ) 

ij i 

where cj creates a fermion on site i of the 2D Lieb lattice, 
the unit cell of which is given by A, B, C sites shown in 
Fig. [T] For simplicity, we take the hopping amplitudes, 
tij = t, between NN sites (ij), and = otherwise for 
the moment. The effect of adding longer-range hopping 
amplitudes (but small in magnitude) will be discussed 
later when appropriate. Note that the C4 point group 
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symmetry dictates that the onsite potentials on the B 
and C are equal, Eb = £c- Although £ia,b,C) are gener- 
ically non-zero, only their relative values are essential to 
determine the symmetry of the lattice, and hence, the 
band structure. Therefore, hereafter we set the units of 
energy 4=1, the lattice constant a = 1, and, without 
loss of generality, eb — £c = 0. 



A. Band structure 

The band structure of Eq. ([I]) can be obtained by trans- 
forming "Ho into momentum space, 



a "spin" L in an external "magnetic field" B, its eigen- 
values can be easily read out as e(B) = «f|p|Z p , where 
l p = 0, ±1 are the quantized angular momenta along the 
axis parallel to B in three dimensions. 
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where the fermion spinor, ip^ = ( c Ak> c sk' c ck)' with sub- 
lattice (basis) index A,B,C and k = (k x ,k y ). Defining 
the displacement vectors, ai = (1/2, 0) and &2 = (0, 1/2), 
flo(k) is of the form 

ea — 2icos(k-ai) — 2icos(k-a2) 


where the lower triangular matrix is understood to be 
filled for keeping the whole matrix hermitian. In this no- 
tation, the first Brillouin zone (FBZ) is a square with 
four time reversal invariant momenta (TRIM): T = 
(0,0), X = (tt,0),M = (7r,7r), and Y = (0,tt) [see the 
inset of Fig. [2ja)]. The energy spectrum consists of 
two dispersive bands, e±(k) = \{ea ± ^/ £ \ + 4^k) with 
6k = X)i=i[2i cos (k ' a i)] 2 > an d one dispersionless flat Hq'(j>) ~ — 
band, eo(k) = 0. 

An important feature of this model is that the presence 
or absence of ea can change electronic properties dramat- 
ically. When ea = 0, the flat band touches two linearly 
dispersing bands at M point in the FBZ [type (i)], where 
the linear bands meet as if there were a "Dirac point" . 
However, the touching point in fact has completely dif- 
ferent structure. It becomes clear once we expand Hq (k) 
around M point with k = M + p, |p| < 1. To the first 
order in p, -ff (k) can be written as 



FIG. 3: (Color online) Vortex structure of the BCP in p space: 
(a) the planar vector field B'; (b) the planar vector field B. 



When ea =/= 0, however, the spin-1 structure men- 
tioned above is no longer valid. The flat band now 
touches only one dispersive (massive) energy band either 
above or below at M point, depending on the sign of ea 
[see Fig. [2] (b)]. To make this structure transparent, we 
again expand -ffo(k) around M with small p. Assuming 
|p| \£A/t\ and ea < at 2/3 filling, we then inte- 
grate out the contribution from basis A (due to almost 
fully filled A sublattice) and obtain a low-energy effective 
two-band Hamiltonian, 



m 



Px PxPy 
PxPy P 2 y 



= dil+d x o x +d z o z , (6) 



where mo 

T eff 



JJo(B) ~ v F L ■ B, 



(4) 



where the Fermi velocity vp = t, B = {p x ,Py, 0), and the 
(pseudo) spin-1 matrices are defined as 



L x — 




, Ly — 




,L Z = 




obeying Lie algebra of SU(2), i.e., [£,;, Lj] = i 
stead of a Clifford algebra as in the case of graphene. This 
is the fundamental reason why there is no Dirac point and 
hence no fermion doubling problem^ on the Lieb lattice. 
Viewing the low-energy effective Hamiltonian Hq(B) as 



—SA/vp. In the last equality, we ex- 
press Hq TJ in terms of the identity and Pauli matri- 
ces with di = \{pl + p^mp 1 . d x = p x p y /m , and 
d z = j{p x — p^rriQ 1 . Interestingly, if we further al- 
low small third-neighbor hoppings t" > (but forbid to 
hop whenever there is a site in the middle of the path), 
the flat band becomes slightly dispersive and the effec- 
tive Hamiltonian changes to di = \ {p 2 x +Py)(m^ ) 1 —t"), 
d x = PxPy/mo, and d z = \{p 2 x - p^im^ 1 + t") with- 
out removing the band crossing point (BCP) [see Fig. [2] 
(b)]. Such point at p = is the so-called quadratic band 
crossing point (QBCP), which has been studied recently 
by several research groups i 19 ' 28 " — One of the key fea- 
tures for QBCP in 2D is that its density of states (DOS) 
is non-zero at the crossing point, in sharp contrast to the 
case of Dirac points. This will lead to essential differ- 
ence when responding to the weak interactions present 
in the system. In the following, we will mainly focus on 
the ea 7^ case and show that the BCP in our model 
is not only topologically non-trivial, but also make the 
system be a potential host to topological phases under 
weak repulsive interactions. 
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B. Topological nature of the band touching 

The band touching phenomenon on the Lieb lattice 
is quite generic and stable for non-interacting fcrmions. 
Such stability deserves a full analysis here. We shall pro- 
vide two different approaches to show it: One is based 
on momentum-space topology, and the other one is based 
on real-space topology. 

From the first point of view, the BCP actually forms 
a topological defect in the momentum space, similar to 
a vortex in a 2D superconductor, here with a wind- 
ing number ±2. To see this, let us rewrite Eq. ([6]) as 
Hq^ (p) = djl + B'(p) ■ a, where the "magnetic field" 
B'(p) = (d x ,0,d z ). This effective Hamiltonian now rep- 
resents a spin-1/2 particle sitting in a magnetic field 
B', which has a vortex structure at p = 0, as shown 
in Fig. (Ha). For comparison, recall that for ea = 
we instead have a spin-1 particle in an external field B 
[Eq. (J2J], whose structure is shown in Fig. EJb). The 
winding number W then can be easily extracted from 
the figures that in the former case, W = 2; in the latter 
case, W = 1. However, somewhat counter intuitively, 
both cases are associated with the same Berry phase of 
the BCPj^I which can be calculated precisely by 



B' 



i J> dp 



^np |^p I 



(7) 



where r is a contour in the p space enclosing the touching 
point, n denotes any one of the involved bands, and |u np ) 
represents the Bloch wave function for nth band. A sim- 
ple argument solves this puzzle. The line integral along 
any loop enclosing in p space given above is known 
to be 1/2 (1) times the solid angle subtended by B'(p) 
[B(p)] from the origin for a spin 1/2 (1) particle. Thus, 
B" = 2irW/2 = 2ir in the former case, which is just 
equivalent to B n = 2irW = 2n in the latter one. In 
fact, when B n = 0, any infinitesimal mixing (pertur- 
bation) between bands would lift the degeneracy. With 
non-vanishing B n = ±2ir, we confirm that the BCP on 
the Lieb lattice at non-interacting level is topologically 
stable (i.e., not opening a gap) as long as the spinless sys- 
tem preserves both TRS and C4 point group symmetry. 
Note that C4 symmetry in our model is quite essential, 
as a similar QBCP happens in the A-B stacking bilayer 
graphene (with C3 symmetry) while it can easily decay 
into Dirac BCPs and thus is topologically unstable! 19 ' 22 
An alternative point of view for the protection of such 
BCP on the Lieb lattice can be associated with cer- 
tain topological structure present in the real space, or 
more specifically, with the existence of the eigenstatcs 
which are extended along non-contractible loops winding 
around the whole lattice with periodic boundary condi- 
tions (i.e., a torus)^ To demonstrate this feature, we 
first take the merit of the flat band, which allows us to 
construct its corresponding localized, one-particle eigen- 
states of "Ho (Wannier states) . Taking R to be the coor- 
dinate of the central site of the shaded plaquette shown in 
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FIG. 4: (Color online) Schematic plot of the localized eigen- 
state at R 011 the Lieb lattice (sa 7^ 0). Only those sites 
in the shaded area have non-zero weights, whose magnitudes 
are denoted by numbers (up to a normalization factor). The 
weights on A sublattice (blue dots) are all zero. 



Fig. 01 we find that the creation operator for the localized 
cigenstate at R can be written as 



^ = ^[E(-w4 H 



,,t 



,,t 



3 = 1 



(8) 

where t>i = ai,b2 = a2,b.3 = — bi,b4 = b2, bs = 
(l,-l/2),b 6 = (l,l/2),b 7 = (l/2,l),b 8 = (-1/2,1), 
b 9 = -b 5 ,bio = -b 6 ,bn = -b 7 ,bi2 = -b 8 . The 
key reason for these states being localized is rooted on 
the fact that all A-sites have vanishing amplitudes and 
remain zero after the action of "Ho on them due to de- 
structive interference. 
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FIG. 5: (Color online) The two non-contractible loop states 
winding the lattice along periodic x direction (a) and y direc- 
tion (b). Only those sites in the shaded area have non-zero 
weights (denoted by numbers in the plots). The weights on 
A sublattice (blue dots) are all zero. 



In localizcd-state language, the existence of the BCP 
in our model with ea 7^ is equivalent to state that the 
dimension of the space expanded by independent local- 
ized eigenstates with zero energy has a dimension which 
is one larger than the number of unit cells, N. The extra 
state cannot come from the flat band, but from one of the 
dispersive bands. The plaquette states we constructed in 
Eq. {51) seem to form TV linearly independent states with 
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zero energy. For our model with periodic boundary con- 
ditions, however, the following relation, 



A 



t 

q=(7r,7r) 



0, 



(9) 



R 



reduces the naive counting by one and hence only N — 1 
states are independent. The missing two states, in fact, 
are accounted for by two non-contractible loops around 
the whole lattice (torus), as illustrated in Figs.OJa) and 
(b). When T-Lq acts on these states, the destructive in- 
terference again guarantees the zero eigenvalue. Now, in 
total we have N + 1 independent states. Therefore, pro- 
vided not destroying the flat band, such band touching 
phenomenon is protected by the topological character of 
the lattice. 



III. INTERACTION DRIVEN INSTABILITIES 

The existence of such symmetry /topology protected 
BCP on the Lieb lattice at the non-interacting level mo- 
tivates us to further ask if it is stable in the presence 
of repulsive interactions. To sec this, wc will first exam- 
ine whether generic short-range repulsions are relevant to 
this BCP from perturbative renormalization group (RG) 
analysis, and next, if the interactions are relevant, we will 
investigate possible consequences of such instability, i.e. 
symmetry breaking phases, at mean-field (MF) level. 

To perform RG analysis, we consider a continuum, 
spin-1/2 Hamiltonian, which can be obtained by project- 
ing the original three-band interacting model onto an ef- 
fective two-band theory near the BCP in the continuum 
and \ea\ 3> t limit, 



H 



eff 



Hn ff + U 



eff 



where the free part "Ho reads as 



eff 



E 



dr^l(r)Hg ff ^ a (r 



(10) 



(11) 



The subscript a denotes spin polarization and the 
fermion field ^J. = (V4 CT) ^Jo-) with 1,2 representing or- 
bital (i.e., two touching bands) degrees of freedom. Note 
that in the momentum space the expression for is 
given by Eq. (|6]), and is independent of a. For simplic- 
ity, we take small t" = —t 2 /eA such that di = 0, mak- 
ing the effective theory particle-hole symmetric. In fact, 
non-vanishing di would not change our main conclusion, 
provided njp 1 > t" . The projected interacting part in- 
cludes only 1) intra-orbital and 2) inter-orbital contact 
interactions, 



eff 



U e ff , njeff 



(12) 



E"/ dr V , l t (r)V'i4.(r)V'a4.(r)V'at(r), 

a=l J 

J2 g <™' J dr V'L( r )V , L'( r )V ) 2<T'(r)V'i<T(r), 



where u and g aa i are intra-orbital and inter-orbital cou- 
pling parameters, respectively. 

For the chemical potential fi = 0, the non-interacting 
system leads to one Fermi point at p = with non- 
vanishing DOS, instead of a Fermi surface. Setting the di- 
mension \p] = 1 and understanding the dynamical critical 
exponent z = 2 due to quadratic dispersion, it is straight- 
forward to see that the dimension [ip acr (r)] = 1; in the in- 
teracting part the coupling constants [u] = [g a a'\ = 0, im- 
plying that they are superficially marginal interactions. 
However, as shown in Appendix A, we find that they are 
generically marginally relevant and bring the system to 
the strong coupling regime. More explicitly, up to one- 
loop order, the coupled RG equations for the coupling 
parameters are 



du 

~d! 

dgn 
di 

dgn 
di 



(27 - a)u 2 + 2>yg n u - 2jg n g n , 

{a - 2j)g^ - 2jg n u + 2jg n g n , (13) 



where we have used the fact that g^ — g^ and 
g-fl = g^. 1 denotes the momentum rescaling p — > 
pe~ l and the coefficients a = 2 n 2 \t\ -^(Vl ~ ^~ 2 ) an d 

7 - 8ff s ( _i +t -4)|t| ' Wltil A W 

[-E(x)], the elliptic function of first (second) kind and 
i = (t?1q 1 + t")/rriQ ■ In fact, no new fixed point (FP) 
is produced in this set of RG equations, except for the 
non-interacting one at which u and g aa i vanish. More- 
over, we find that given generic bare coupling param- 
eters (u,g aa i > 0), at least one of them diverges first 
when reaching low enough energy scale. This indicates 
that the non-interacting FP is an unstable FP, which can 
drive the system to strong coupling regime in the pres- 
ence of short-range repulsions. In addition, it is worth 
mentioning that by setting = u = 0, we reduce the 
RG equation back to the spinlcss case, 



dgn 
dl 



(14) 



with a > 0, which is consistent with the work done in 
Ref. [l^ and, importantly, it implies that short-range re- 
pulsions are again marginally relevant. 



A. Spinless fermions 

From above we know that a QBCP is generally unsta- 
ble against weak repulsive interactions. We now discuss 
its consequence on the Lieb lattice and explore possi- 
ble symmetry breaking phases driven by interactions at 
mean-field level. We warm up with the spinless case to 
gain some physical insights before including spin degrees 
of freedom. 
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The lattice model we study is given by Eq. (p}, with 
short-range interacting terms, 



(a) 



(b) 



Hi 



(ij) 



V 2 riiUj, 



(15) 



where V\ and V 2 are repulsive coupling constants for NN 
and NNN interactions, respectively, n,; = c\ci is the num- 
ber operator on the site i. The chemical potential is suit- 
ably chosen to keep the system at 2/3 (1/3) filling for 
ea < (sa > 0). We proceed by treating Hint in the 
MF approximation, including both the on-site and bond 
MF decoupling particle-hole channels, 



iUj -> ni(rij) +rij(rii) — (n,i){nj), 



(16) 



•XliUj 



V-;<:, • o,,o; r (17) 



where 4>ij = 4>* i = (c\cj) represent certain current/bond 
order with i,j belonging to NN and NNN bonds. Note 
that in this work only translation-invariant MF ansatz is 
considered. The repulsive interactions can produce the 
following possible phases: 

(i) Nematic state. This is a phase associated with 
broken C4 symmetry down to C2. It behaves like 
an anisotropic metal (one QBCP splits into two Dirac 
points) or an insulator (two Dirac points meet at zone 
boundary and end up with a gap), depending on the 
strength of repulsive interaction. There are two types 
within this phase. Type I is "site" nematic with or- 
der parameter, rj = § Ea' (( c L c b«) ~ (cci+6> c Ci+6')), 
where 6' = ±x/2 ± y/2 denoting four NNN bonds of 
B-site and A, B, C are sublattice indices. Without loss 
of generality, at 2/3 filling we can set the charge den- 



sity, (c Ai c A i) = 



c Bi c Bi ) 



tj + 77, and 



( c Ci c Ci) = § — § ~ ^- As £a > 0, at 1/3 filling we simply 
replace 2/3 by 1/3 in the above expression. Note that the 
use of the parameter p is to take into account the renor- 
malization of the onsitc potentials due to interactions. 
The nonzero expectation value of it docs not break any 
symmetry of the model. On the other hand, type II is 
"bond" nematic with order parameter either in the form 

Of Qi = \^e^Z s=±i {c Ai CBi+s) - Y,5=±y( c Ai c Ci+5)}, 

or in the form of Q 2 = \J2s> Ds'Re(c Bi c C i + s>) for 
Ds'=±(z/2-§/2) = 1 and A5'=±(i/2+y/2) = Tne sub- 
script of the order parameters indicates their origin of 
cither V\ or V 2 repulsion. 

(ii) Current loop state. This type of phase is fea- 
tured by spontaneously TRS breaking. The most proba- 
ble current patterns which preserve translational invari- 
ance with no (charge) source and drain present on the 
lattice sites are shown in Figs. Elja)-(d). Each state 
basically comes from non-vanishing imaginary part of 
certain bond orders in the MF decouplings and may 
behave Hall-insulating [3(a)], semi-metallic [3(b), 3(d)], 
or insulating [3(c)]. In particular, the most signifi- 
cant one is case (a), which exhibits quantum anoma- 
lous Hall (QAH) effect with order parameter, $2 = 
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FIG. 6: (Color online) The current loop ground states for (a) 
$2/0 and others are zero (QAH state); (b) $i,$ 2 / and 
others are zero (Varma 6 j loop) (c) $i , $2 = $2" / (Varma 
9// loop); (d) $i = $i',$ 2 " / 0. 



jlm^^, D$i (c Bi cci+s')]- This topological state is known 
to be characterized by quantized Hall conductance with- 
out Landau levels (or equivalently, by non-zero Chern 
number) and has topology-protected, gapless chiral edge 
modes.— We compute the Chern number for each band 
within this state and find that 1) for le^l > 0, the pre- 
vious two touching bands now carry Chern numbers ±1 
separately. In particular, one of two bands is (nearly) 
dispersionless. The third one simply carries zero; 2) for 
ea = 0, the middle flat band carries zero Chern number, 
while the upper and lower bands carry ±1, respectively. 

The other possible current loop states, however, are 
not topological insulating. For case (b) (Varma 0/ loop 
stated), it is semi-metallic with order parameter given 



by, 



simultaneously, $1 = |Im[^ 



=±9/2 



(c Ai cci+s)} and $ 2 = \ J2 S > lm(c Bi c C i+S') ■ For 



8=±x/2 l \ C \i C Bi+S 

,t 



case (c) (Varma Qu loop stated), it is insulating with 
broken inversion symmetry (IS) as well but is invariant 
under the combined TRS and IS. Thus, there is no Hall 
or uniform Kerr response by noticing that for any given 
momentum k it changes sign under TRS or IS £2- This 
order can be described as, 7^ 0, $ 2 ' = ^2" 0> where 



y){c f Ai cci+ S )], n = ^m[J2 sl (25 / -x)D sl (cl l c Ct+ s')}, and 
3 Im Ed-'( 2(S ' ' &)( c Bi c Ci+&')\- Finally, case (d) is 



a semi-metallic state with broken IS and hence no net 
Hall current in it. Its order is described as $ 2 " 7^ 0, ^'1 



±x/2 



(25 



x){c Ai c m+s ) 



$'/ ^ 0, where $'/ = jlm[J2s= 

T,S=±y/2( 2S ■ y)( C Ai C Ci+s)}- 

In momentum space, the mean-field Hamiltonian at 
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2/3 filling can be now written in the matrix form, 



(a) 



= H*k(#k-M/)*k + £o, ( 18 ) 

k 



with the fermion spinor, \I/ k = (c Ak , c^ k , c^ k ), and 
iVe A i(£Bi + £ci) Ne B2 e C 2 

rLn = 

+ 4NV 2 (St 12 + Ql + <S>1 + &2 + $ 2 ' 2 + $ 2 /2 ) 
+ 4AVi(^ 2 + Q 2 + $ 2 + <I>' 1 2 + $' 1 ' 2 ), (19) 

where 5t (rSt') represents a rcnormalization due to 
NN(NNN) repulsions. The Hamiltonian matrix reads 



y 



Hk = I £bi + £B2 + Vy T xy 

Sci + £C2 + v x , 

(20) 

where e A1 = Vi(8 - 6p)/3, e B1 = 2V 1 {2 + 3p)/3, e S2 = 
2V 2 (4 - 3p - 6t7)/3, £ C i = 2Vi(2 + 3p)/3, e C2 = 2V 2 (4 - 
3/? + 677) /3, and = — 2t" cos fc^; T parameters are 
given by 



\ v = (-2tT2y 1 (Q 1 -z$ 1 ))cos^ 
- 2T/ 1 ($i±$' 1 ')sin^, 



T xy = 4iV2$ 2 cos ^ cos + 4V2$ 2 "sin^cos^ 



-tt cos -7 
2 2 

4^ 2 (Q 2 -z$ 2 )sin^sin^ 
4 y 2 $''cos^sin^. 



^2: fe^j 

— COS -7 

2 2 



2 2 

Thus, the mean-field free energy can be expressed as 



(21) 



F = -— VWl 

/3iV V 



•En 



(22) 



where /3 = 1/ksT and i?k are eigenvalues of ifk- The 
ground state with given coupling parameters can then be 
determined by minimizing the free energy with respect 
to each order parameter, yielding a set of coupled gap 
equations. Notice that at 1/3 filling we follow the same 
procedure and only the diagonal part of and Eq need 
to be changed accordingly due to the shift of the average 
charge density. 

We numerically solve the coupled gap equations self- 
consistcntly and obtain the zero-temperature V1-V2 phase 
diagrams at both 1/3 (ea — 4i) and 2/3 {e A — — 4t) fill- 
ings, as seen in Figs. Eta) and (b). Note that in this 
study, only weak short-range repulsions, i.e., V±,V2 <t 
are considered. At 1/3 filling, we find that there are 
three phases in the absence of V\. QAH phase, coexist- 
ing QAH+ncmatic phase, and nematic phase. Beginning 
with V 2 -C t, the infinitesimal instability of QBCP leads 
to QAH phase by the second order phase transition, with 
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FIG. 7: (Color online) Schematic zero-temperature mean-field 
phase diagrams for spinless fermions on the (a) 1/3-filled lat- 
tice with e A /t = 4, t"/t = -0.1 and on the (b) 2/3-filled 
lattice with e A /t = —4, t" jt = 0.1. The shaded area repre- 
sents the coexistence region. 



a T = gap, A QAH = (F 2 $ 2 ) oc Aexp(^), where N 
denotes the finite DOS at QBCP and A is an energy cut- 
off; on the other hand, for t > V 2 > V 2c ~ 0.22i the 
ground state breaks C4 symmetry spontaneously down 
to C 2 and exhibits insulating nematic phase with a gap 
Ajv ~ T}. In this phase, we find that the site-nematic 
order (77) is the dominant one and a small component 
of the bond-nematic order (Qi) accompanies with it. In 
fact, we notice that the bond-nematic order cannot be 
induced by V\ itself. Finally, with intermediate value 
of V2, there exists a narrow window for the coexistence 
of both QAH and nematic orders. In addition, we also 
notice that there is no room for the current loop states 
other than QAH state for systems with relatively large 
\ea\ and weak repulsions. 

At 2/3 filling, the phase diagram is qualitatively sim- 
ilar to that at 1/3 filling. However, there are a few 
remarks worth mentioning here: 1) Although the non- 
interacting energy spectrum for both fillings can be 
related by translating "particle" into "hole" language, 
which causes t —t, t" —t", ea —£a-, and 
fi — > —fx. The interactions given in the present form ruin 
such relation and hence the two phase diagrams must 
be differential 2) The response to the weak V\ repul- 
sion is different for the two cases. At 1/3 filling with 
£a^> Vi > 0, since the charge density on A sublattice is 
much less than 1/3, the stronger V± is, the more energy 
cost the system suffers from V 2 - Thus, the region of the 
QAH phase reduces and the ground state evolves into 
the nematic phase faster than the case with V\ = 0. In 
contrast, at 2/3 filling with \ea\ ^ Vi > 0, the presence 
of small V\ can only reduce the charge density slightly 
on A sublattice, and therefore its effect on the energy 
cost from V 2 is relatively small. 3) When £A,t" — > 0, the 
spin-1 structure near band touching point, as discussed in 
the previous section, is recovered. Our mean-field study 
shows that the infinitesimal instability (near 1/3 or 2/3 
filling) is absent due to the vanishing DOS of the dispcr- 
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sive bands and the semi-metallic phase is robust until Vi 
reaches certain critical value. Moreover, for V2 > Vic-, 
we find that the QAH phase only survives in a negligi- 
ble window of V2, and the nematic phase becomes the 
dominant one in the phase diagram (not shown). This 
result is similar to the work done by Q. Liu et a/.— on 
the 2/3-filled kagome lattice with Dirac BCPs. 



B. Spinful fermions 

We now take the spin degrees of freedom into account. 
The model Hamiltonian again consists of the free and 
interacting parts, i.e, % = Ho + Hint- The free part is 
again given by Eq. ([1} with extra spin index a in the 
fermion creation/annihilation operators; the interacting 
terms now contain 

Hint = y^^~l Vin t , a nj,a' + X] ^ni, a nj,a' 

(ij) <j,<j' ((ij)) <j,<j' 

+ y^Ujni^nj^. (23) 

i 

In addition to V\ (V2) denoting the coupling constant of 
NN (NNN) repulsion, we also consider the repulsive Hub- 
bard (Ui) terms. For simplicity, we will assume uniform 
onsite repulsions, i.e., Ui = U. 

Different from the spinless case, there are not only 
spin-singlet order parameters (as we had before), but also 
spin-triplet order parameters within mean-field approxi- 
mation. The possible phases under translation-invariant 
ansatz are classified below: 

(i) Charge nematic state (CN). This phase is associated 
with spontaneously rotational (C4) symmetry breaking. 
One can either have the site-nematic or bond-nematic 
state, whose order parameter is a spin-singlet and simply 
the same as that for spinless fermions with additional 
summation on spin a times a normalization factor 1/2. 
Note that for the site-nematic case, the driving force is 
now from both U and V2 terms, combined together to 
give out an effective NNN repulsion, V 2 ' = 2(V2 — 
playing similar role of V2 in the spinless model. 

(ii) Nematic- spin-nematic state (NSN). This phase 
breaks C4 symmetry in the spin sector, not in the charge 
sector. Consequently, it turns the (spin) doubly degener- 
ate QBCP into four Dirac points (two pairs with opposite 
spin polarizations), and C4 symmetry of the band struc- 
ture remains intact. Similar to its charge counterpart 
in (i), there are two types: One is the site-NSN with a 
spin-triplet order parameter, rf=jQ ^2$<{SBi — Sa+5'), 
where S Q = (c^ ? ; a s aa 'C a i M >) with a = A,B,C and s, 
the Pauli matrices. Note that this phase can occur 
simply due to the presence of the Hubbard term, 
which provides a spin-triplet channel, — ^U(Si) 2 with 
Si representing usual spin operator. The other one 
is the bond-NSN, which is described by Q[=^Rc[ 

J25=±x/2( C Ai,a S <?<?' C Bi+S,a')-J25=±y/2( C \i,a S <?<?' C Ci+$,cr')] 
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FIG. 8: (Color online) Schematic zero-temperature mean- 
field phase diagram for spinful fermions at 2/3-filling with 
e A /t = -4, t"/t = 0.1, and Vi = 0. The short-hand nota- 
tions represent: NSN = nematic-spin-nematic; QAH = quan- 
tum anomalous Hall; QAH = quantum anomalous Hall; CN 
= charge nematic. The shaded area denotes the coexistence 
region. 

or Q2=\Y.S' D S'~R- e ( c Bi,a s <™ ,c Ci+s,a>) (breaking C 4 
along a diagonal direction of the lattice). 

(hi) Charge current-loop state with broken TRS. As 
mentioned in the spinless model, among all the current 
patterns the case (a) in Fig. [6] is of most interest. This 
state, characterized by spontaneously broken TRS and 
parity symmetry, exhibits QAH effect with a spin-singlet 

order parameter, $ 2 = | Im Ed'' l( r D S' (c Bl . a cci+S' ,a)}- 
Mainly driven by V2 terms, fermions with opposite spin 
polarizations flow in the same way and hence provide the 
same flux pattern, penetrating the whole lattice. In addi- 
tion, we investigate the possibility for the other current- 
loop states [e.g., from Fig. Etb)-(d)] and find that none of 
them is stabilized by the presence of short-range repul- 
sions in our MF study. Therefore, we will only consider 
case (a) hereafter. 

(iv) Spin current-loop state with TRS. The key differ- 
ence of this phase from its charge counterpart (QAH) is 
TRS unbroken. One can view it as a combined double- 
layer QAH system: Fermions of opposite spin polariza- 
tions, residing in different layers, producing just oppo- 
site flux patterns separately. Thus, for the whole system 
TRS is preserved. In fact, this is known as quantum 
spin Hall (QSH) phase with spin-triplet order parame- 
ter described by $1 = ± J^s' D S' lm [( c m a s ™'Cci+5',a>)\- 
Two remarks deserve mentioning here. First, both QAH 
and QSH are topological phases, characterized by non- 
trivial topological index with robust edge states. How- 
ever, the former one acquires non- vanishing Chern num- 
ber, while the latter one has zero Chern number due to 
TRS. Thus, a new topological index, called Z 2 index v, 
needs to be introduced4^^ As detailed in Appendix B, 
the QSH phase on the Lieb lattice indeed acquires non- 
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trivial v = 1. Second, it is straightforward to see that 
at MF level, the energy spectra for both QAH and QSH 
are the same. As a result, they have equal energy gain 
from V 2 repulsion and hence one cannot distinguish them 
in the MF phase diagram. If there were an extra NNN 
exchange coupling J 2 present in the system, the QAH 
would be favored for J 2 > 0; reversely, the QSH would 
be favored for J2 < due to its spin-triplet nature. 

Under our assumption of translational invariance 
within our mean-field study, we do not consider any 
charge or spin density wave order. However, it is still 
worth pointing out that if le^l — > 00 and hence makes 
the A sublattice be effectively decoupled from rest of the 
lattice sites, at large U the (0,0) antiferromagnetic or- 
der could be realized at 1/3 (2/3) filling with ea > 
(ea < 0), as guaranteed by the Lieb's theorem^ 

Following the same procedure as in the spinless case, 
we decouple the interacting terms within MF approxi- 
mation and obtain the MF free energy in similar form of 
Eq. (12"2"|) . where we have used the MF ansatz, (riAi : a) = 
l+p+\aS Az , (n Bi ,a) = |-f +ri+\a{S B z + ^rfz), and 
(na,a) = § - f - »7 + h°( S Bz - 2??') for the 2/3-filled 
lattice. Note that, for simplicity, we have assumed that 
spin points to z-direction after SU(2) symmetry break- 
ing. Such treatment will be applied to other spin-triplet 
order parameters as well. Eq in the spinful case becomes 



Eo 
N 



£Al(£Bl + ECl) £S2£C2 



m(6t' 2 + Ql 

~~^(Saz + $Bz 



s, 



2 

Cz 



v 2 



+ 8V 1 (St 2 



Qi + Qfz 



{e B i + eci) 2 , £ 



B2 



'C2l 



16U 2 2 



(24) 



where e~ai, £bi, £B2, £~ci, and £~C2 are defined as before. 
-Ek are eigenvalues of the MF Hamiltonian, which is now 
a 6 x 6 matrix. 

By minimizing free energy with respect to various or- 
der parameters, the T = mean-field U-V 2 phase dia- 
gram at 2/3 filling (ea = — 4t) for spinful fermions is 
shown in Fig. [5J We first notice that in the absence of U 
there again exist three phases: QAH/QSH phase, coex- 
isting QAH/QSH+CN phase, and CN phase from weak 
to strong V 2 repulsion. In particular, the fact that topo- 
logical QAH/QSH phase can arise from infinitesimal in- 
stability of QBCP further justifies the interaction-driven 
scenario as a promising way for producing TI. In the 
presence of U, however, NSN phase begins to compete 
with the topological phase and clearly dominates over 
QAH/QSH whenever U > V 2 > 0. On the other hand, 
as V 2 ' = 2(V 2 - j ) > 0.22£, the insulating CN phase 
takes over the phase diagram and this is consistent with 
the result shown in the spinless model. Two remarks are 
worth mentioning here. The first one is about the effect 
of NN repulsion V\, As in the spinless case, at 2/3 filling 
the phase diagram is not sensitive to the presence of V\ . 
Especially, V\ itself does not lead to any order. How- 



ever, when V\ becomes stronger, it is quite possible that 
the system might gain certain energy by opening a gap 
due to translation symmetry breaking, and hence beyond 
our current consideration. The second point is about the 
system at 1/3 filling with ea = 4t. In fact, the phase 
diagram is qualitatively similar to that of 2/3 filling and 
therefore we omit it without further discussion. 



IV. DISCUSSION AND CONCLUSION 

The model we have solved on the Lieb lattice demon- 
strates that the TI (QAH/QSH state) can be induced 
by appropriate interactions through spontaneously sym- 
metry breaking mechanism, which dynamically generates 
spin-orbit couplings necessary for a topological insulator. 
It is then natural to ask how it can be realized experi- 
mentally. 

We notice that in the interaction-driven scenario there 
are two key conditions that a system has to fulfill: 1) 
The band structure should contain suitable band crossing 
point at which two touching bands have opposite curva- 
tures. 2) The system should have weak (or no) spin-orbit 
coupling [spin SU(2) symmetry is preserved] and NNN re- 
pulsions need to be more significant than the other short- 
range repulsions. While the condition 2) is tricky and we 
have to reserve it for future investigation, we would like 
to comment on some possible routes for condition 1) be- 
low. 

First of all, the most promising candidate, we believe, 
is from cold atom system. As discussed by Goldman 
et al. in Ref. HH, the Lieb lattice may be constructed 
as an optical lattice created by properly arranged laser 
beams. In particular, the spin-orbit interaction, which 
might be an issue in traditional materials, now becomes 
irrelevant. Another potential way for realizing Lieb lat- 
tice may come from layered perovskites. A well-known 
example is the Cu02 plane in high-T c cuprates such as 
Lai_ K Sr a; Cu04 or YBa2Cu307, whose electronic struc- 
ture might be captured by a three-band model with p x , p y 
and d x 2_ y 2 orbitals. Here, for illustration purpose we 
take a typical three-band (Emery) model, written in hole 
language, having the same form of Eq. ([T]) i 39 ' 40 The cor- 
responding model parameters are given by Hybertsen et 
al42: t = 1.5, t' = 0.65, ea = 0, and £b,c = 3.6, where 
t' denotes NNN hopping. The band structure in the 
FBZ along high symmetry lines is presented in Fig.[9][a). 
As one can see, there is indeed a BCP at M, but with 
"wrong" curvatures for two touching bands. As a result, 
cuprates may be impractical to produce topological phase 
as we desire. To overcome this issue, we offer two specu- 
lative suggestions. The first way out is to add decorated 
elements with suitable orbital nature (e.g., p-orbital) be- 
tween atoms on B and C sites that could change the sign 
of t' . This change leads to the band structure shown in 
Fig-in^b) with "right" curvatures now. Keeping the same 
orbital characters, the second way is to search for a new 
system among pcrovskitc materials, whose model Hamil- 
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tonian is similar to that given by Sun et al.'s recent work 
in Appendix F4£ The key feature of such three-band 
model is that the dominating transfer integrals are now 
associated with distance a after hopping. For instance, 
if, by certain geometric reason, the relevant orbital on B 
(C) sublattice becomes p y (p x ), instead of p x (p y ) as in 
the cuprates, the above consideration could be plausible. 



elt 




r x m r 

(a) 




r x m r 



(b) 

FIG. 9: (Color online) (a) Energy spectrum of the model 
for cuprates along the high-symmetry lines in the BZ with 
parameters mentioned in the text, (b) The same model as 
used in (a), but with reversed sign of t' . 

Before concluding our work, we would like make a 
brief remark for the possible new physics brought by the 
(nearly) flat band appearing in the Lieb lattice. Con- 
sider ea > and only NN hoppings in our spinlcss model. 
Now, the middle band is completely flat and touches with 
the lower dispersive band at M in FBZ. At 1/3 filling if 
we turn on V2, the ground state would enter QAH state 
with an energy gap Aqah opened at M. As we have 
mentioned in Sec. Ill A, the middle and lower bands ac- 
quire Chcrn numbers ±1, while the upper one has zero 
Chcrn number in this phase. Moreover, the flatness of 
the middle band is approximately determined by the ra- 
tio of band-gap to bandwidth ~ 0(€a/ Aqah )• In other 
words, with appropriately chosen €a/ Aqah, one can pro- 
duce a nearly flat band with non-trivial Chern number. 
This result is quite significant since it may provide an op- 
portunity to realize fractional QAH state (or fractional 
Z2 TI in the spinful case) when such band is partially 
filled4i-i2 

In conclusion, we have studied interacting spin- 
less/spinful fermions on the (extended) Lieb lattice and 
have explored the possibilities of various spontaneously 
broken symmetries associated with a BCP in the band 
structure. Due to the topological nature of the BCP, 
namely, with Berry phase 2n 7 we have seen that in the 
T = phase diagram the system can exhibit topological 



QAH/QSH, ncmatic, and nematic-spin-nematic phases, 
depending on the strengths of short-range density-density 
interactions. In particular, the existence of TI phase 
firmly justifies the interaction-driven scenario. Moreover, 
for a quadratic BCP (as eA,t" ^ 0), only weak interac- 
tion is necessary for inducing the TI phase, which is in 
sharp contrast to the systems with Dirac points. In ad- 
dition, in our model there exists a flat band, which is 
interesting on its own right and we argue that in princi- 
ple, one can obtain a nearly flat topological band without 
external magnetic field, a starting point to realize ex- 
otic correlated phases of matter. Still, there are many 
open issues and they deserve further investigation. For 
instance, one could consider the effect of the chemical 
potential away from the BCP or the instability to super- 
conductivity from both repulsions and attractions, with 
special focus on the possibility of any topological nature. 
Finally, wc hope our work can further stimulate people to 
search for a new family of TIs in the perovskite-related 
materials, where, due to the presence of transition ele- 
ments, the strong correlations may not be ignored. 
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Appendix A: Perturbative renormalization group 
analysis for a quadratic band crossing point 

In this section, wc derive RG equations given in 
Eq. (|13p in path integral formulation and show the RG 
flows for two typical cases. We begin with defining the 
action and the shorthand notations below. At zero tem- 
perature, the full action is given by 

S = S + S mt , (Al) 

where the free action So reads 

_(A2) 

in momentum space. The Grassmann variables, >f a = 
V^o-) with 1,2 (labeled by 'a' for later use) repre- 
senting orbital degrees of freedom. As mentioned in the 
main text, for simplicity, we consider the inverse of the 
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non-interacting Green's function [Gq(w,p)] 1 = iwl — 
d x a x — d z o~ z , which is suitable for a particle- hole symmet- 
ric QBCP with d x = PxPy/mo, d z = (p 2 x - p^)i/(2m ), 
and t = 2 and is independent of spin polarization a. We 
will hx l/(2mo) as our unit in the analysis. The action 
of interactions can be written as, 



Sint — Si + S*2 
2 



(A3) 



5 1 = ~Y1 l ^a t (4)^(3)V<4(2)Vat(l)> 

a=l J 

5 2 = -J2 [ ^5^^(4)^(3)^(2)^(1), 



where / d£ = FlLi Ho / » and the shorthand 
notation b = (u>b,Pb)- Note that "4=1+2-3" is under- 
stood by energy and momentum conservation and we ig- 
nore the momentum dependence of u and g a<7 ', which 
turns out to be irrelevant in RG sense. In addition, it 
is worth mentioning here that the present RG analysis 
is much simpler than that of usual Fermi liquids in the 
sense that there is no Fermi surface (p_p = 0). This fact 
thus waives the complexity brought by the Fermi surface, 
a situation similar to 4 -theory. 
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FIG. 10: The tadpole diagram, induced by the quartic terms, 
can in principle renormalize the free action. The arrowed lines 
on the left represent the intra-orbital (solid) and inter-orbital 
(dashed) non-interacting Green's functions, respectively. 

Let us now sketch how to obtain one-loop RG equa- 
tions, following the standard perturbativc RG procedure 
by Shankar^ Defining a momentum cutoff A and ip < 
(V>>) as slow (fast) modes with < p < A/s (A/s < p < 
A), the key formula we use to derive the renormalized 
action by integrating out the fast modes is given by 

Z = [ P[^ > ^ > ;^ < V><]e s ^< + ^<+^> ] 



(A4) 



= J V[^ < r/, < ]e s '^<\ 



;o,> 



where 

e s'^<><] = z (A,A/s)e So ^<^< I (e s - 

= Z (A,A/s)e So[ ^<^< 1 

x e [<s. nt )o,>+i«s i 2 „ t ) ,>-<s I „ t ) f l > )+- 



(A5) 



Note that in deriving last equality we have used the cu- 
mulant expansion. Zq denotes the non-interacting parti- 
tion function and ( )q.> represents average with respect 



to the fast modes of action Sq. The collected exponent 
of the exponential terms now results in the renormalized 
action S'. 

Before examining the renormalization of coupling pa- 
rameters u and g aa i , we first notice that, to one- loop 
level, the quartic terms in S% n t do induce quadratic terms 
from the tadpole diagram shown in Fig. 1101 which are 
momentum independent. This would indicate there is no 
non-interacting fixed point in our system. However, ex- 
plicit calculations show that all contributions from such 
type of diagram are zero and hence our starting FP sur- 
vives without flowing (t, ip aa are not renormalized), in 
contrast to the case of the Luttingcr liquid. 

Next, we turn our attention to the diagrams that renor- 
malize coupling parameters. As shown in Figs. [TTt a)-(c). 
they are, respectively, total contributions to the renor- 
malized it, g at 7, and g a s- Obviously, they have stan- 
dard structures such as 'BCS', 'ZS' (zero sound), and 
'ZS" used in Shankar's seminal work^S Note that we 
have taken the convention that 1 = 2, f =1 and vice 
versa. The essential fermion loop integrals are listed be- 
low (without vertex): 



BCS1 
BCS2 
BCS3 
ZS1 
ZS2 
ZS3 



where J q ee £ J* § tf /s £ and t, a(t), 7 (i) are 
defined in the main text [just below Eq. (|T3"|)]. The su- 
perscript, a', of Go can be either a or a. The pres- 
ence of dl is due to the approximation we have used, 
In s = ln(l + dl) w dl in the limit s — > 1. In order to eval- 
uate these integrals, we have set all external uj = p = 
and made q x = qcos9,q y = qs'm9. Combining all the 
Feynman diagrams in Fig. [IT] and keeping in mind the 
order of fermion operators, the straightforward algebra 
gives rise a set of RG equations, as we desire, Eq. (TT3")) . 

Finally, we investigate the RG flow beginning with 
weak coupling regime for two typical cases: (a) u > g aa = 
g aS \ (b) u < g aa = g aS . As one can see in Fig. [12] in 
either case, they all flow to strong coupling regime and 
hence the non-interacting fixed point is actually unstable 
against short-range repulsions. 





= tfi-7(t), 






= <a-7(t), 




G a 0aa {q)Gl aa {-q) 


= dl ■ [a(t) 


-7(*)L 


G a 0aa [q)G° m M = 


-dl ■ [a(t) 


-7(*)L 


Goaa(q) G Oaa(q) = 


dl • 7 (t), 




Goaa{q)Goaa{q) = 


-df-7(t), 
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(a) 




(b) 
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FIG. 11: Diagrams to one- loop level which contribute to 
renormalize (a) it, (b) g CT(T , and (c) g a a- Different types of 
vertices are shown on the left. The labels for external legs in 
each one-loop diagram are the same as the vertex on the left 
and hence are omitted. 



FIG. 12: (Color online) RG flows for u(l) (solid,blue), g n (l) 
(dotted, black), and g-fi(l) (dashed, red) with interaction pro- 
file (a) u(0) = 0.5, 3n (0) = g n (0) = 0.05; (b) u(0) = 
0.05, fftt(O) = 9n(°) = 0- 5 - In both cases > * = 2. 



Appendix B: The proof of non-trivial Z-2 index for 
the quantum spin Hall phase 

The existence of the QSH state can be justified by a 
non-trivial ^-valued invariant v = 1. This Zi index 
represents the topological nature of the QSH state and 
leads to topologically protected gapless edge states when 
the 2D system is made open with boundaries. Here, we 
present a method, first invented by Fu and Kane^, to 
derive Zi index explicitly. This method essentially takes 
the advantage of inversion symmetry such that the index 
can be related to the parity eigenvalues S,2m(^i) of 2m 
occupied energy bands at four TRIM: Ti = T, X, Y, and 
M. 

For the purpose of instruction, we focus on 1/3 fill- 
ing with £a,b,c = and hence only the lower band is 
relevant. As shown in Sec III, the presence of V2 can dy- 
namically generate the "spin-orbit" interaction, which is 
equivalent to add the following term into Eq. ©. 



■Hso 



with Hso(k) = 



± A 



so 



k.cr 




2iw k 
-2iw k 



(Bl) 



(B2) 



where = Y^j=i(~ cos(k-a^) with a' x = ai +a2, 
and &' 2 = &2 ai . The +(— ) sign refers to spin up (down) 



fermions. The eigenvalues of H(k) 
are e±(k) 



ffo(k) + HsoQt) 
±V^k + 4A| w^ and eo(k) = and their 



corresponding eigenstates can be written in the form, 



ik) — G„k (<7Ak, 9Bk, <7Ck) 



(B3) 



where the expressions of the components qi^ (I = 
A, B, C) and the normalization factor G ra k for each band 
n(= 0, ±) are given in Table fl] 



TABLE I: The expressions for the coefficients of |u n k) with 
Xi=k-a^ (i — 1,2). For k = M, the listed expressions 
break down with ambiguity and hence we single them out, 
Km) = (0,l/ v / 2,«/v / 2) T , |w_ M ) = (0, l/y/2, -i/VW and 
|«om) = (1,0, 0) T . Note that the upper (lower) sign in 
the square bracket refers to spin-up (down) fermions. 6k = 
£Li[2*cos(k-aO] 2 



<7Ak 
<?Bk 

qck 



4(k)-4A! < 
2t[e n (k) cosxi ± 2i\soWk cosa;2] 
2t[e n (k) cos X2 =F 2iXsoWk cosxi] 
e^k)[ e ^(k)-4A| oU ; k + 6 k ] 
+4A| w; k (6 k + 4A| w k ) 



At TRIM, we have eigenstates \u-r) = (-^ ; -^-) 7 \ 
= (^,0,^F, | U _ Y ) = (^.Of, and 
\u-m) = (0, ;4g, ^t|) T according to TablcUl respectively. 
Now, let us make a gauge transformation on eigenstates 
such that only one coordinate R would be assigned to 
each unit cell (instead of R + a^ for each atom within 
the cell), and the Bloch Hamiltonian -ff(k) now obeys 
H(k + G) = H(k) and, with the inversion operator 
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P, H(-k) = PH(k)P, resulting in [H(k = T t ),P} = 
0. Thus, the parity eigenvalue now becomes a good 
quantum number at TRIM. Under such transformation 
the eigenstates are rewritten as \u-r) = (-75, -jr, -j-) T 



-x) = (^0,^, |«_ Y > = (^,^,0f, and 



■V2 1 2 ' : 
= (72' 73' 

|u_m) = (0, ^7= ) T ■ Picking up any one of A-sites 
as our inversion center, we can determine the parity 
eigenvalue for each TRIM by examining the wave func- 
tions (eigenstates) in real space. Since moving a unit 
cell by R is simply multiplying our cigenstatc at I\ by 
a factor e iri ' R , we now see the parity eigenvalues for 



Ti=(T,X, Y, M), are, respectively, P=(+, 
Z 2 index v is then determined by 



(-ir = nfc=-i, 



-,+,-). The 



(B4) 



where 8i = rim=i?2m(ri), and N = 1 indicating either 
spin-up or spin-down band in our example here. There- 
fore, v = 1 suggests that the ground state of our system 
at 1/3 filling has topological nature. We summarize the 
parity eigenvalue of each band in Table [TTJ Finally, for 
£a 7^ 0, one can follow similar procedure and the conclu- 
sion of v = 1 is unchanged. 



TABLE II: The parity eigenvalue for n-th band at TRIM R. 



R 


n = + 


n = — n = 


r 


+ 


+ + 


X 


+ 


+ 


Y 


+ 


+ 


M 




+ 



1=1 
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